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We analyze the power of the Tevatron dataset to exclude or discover fourth generation neutrinos. 
In a general framework, one can have mixed left- and right-handed neutrinos, with Dirac and 
Majorana neutrinos as extreme cases. We demonstrate that a single Tevatron experiment can make 
powerful statements across the entire mixing space, extending LEP's mass limits of 60-80 GeV up 
to 150-175 GeV, depending on the mixing. 
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I. INTRODUCTION 

A simple and well-motivated possibility for new physics 
is a fourth generation of quarks and leptons. Contrary 
to some previous arguments [T], such an extension of 
the standard model is entirely compatible with precision 
electro- weak data [2, j5, • 

Direct searches have been performed at the Tevatron 
for heavy fourth generation quarks {t' and h'), placing 
bounds of 335 GeV [4 and 338 GeV [S], respectively, 
on their masses. The LHC will be able to discover or 
definitively exclude the existence of a fourth generation 
of quarks up to 1 TeV [BHE]. 

The lepton sector, though it has great promise, has 
not been studied in such detail. A fourth generation of 
leptons may even be lighter than the fourth generation 
quarks, in analogy to the first three generations. In par- 
ticular, the neutrino may well be the lightest new par- 
ticle. Furthermore, the lepton sector is expected to be 
extremely rich, as the relatively high mass scale for the 
neutrino required by electroweak measurements suggests 
that the right handed neutrino of the fourth generation is 
not very massive. The leptonic sector therefore has two 
neutrino states in addition to a charged lepton. 

For these reasons, it is of great interest to search for 
potential signals of this leptonic sector at colliders. The 
signals, however, are very dependent on the precise spec- 
trum and the three mass parameters complicate the anal- 
ysis. We first consider the simplest case, the limit in 
which the lepton and one of the neutrinos is very heavy, 
and the theory reduces to a single Majorana neutrino. 
LEP2 has placed constraints on fourth generation neu- 
trino masses in this limit [TB], depending on the decay 
mode of the neutrino. If the neutrino decay mode were 
N — >■ eW , the neutrino mass is constrained to be larger 
than 90.7 GeV, with corresponding bounds at 89.5 and 
80.5 GeV respectively for fjW and tW decay modes. 

The more general case has two relatively light neutri- 
nos of comparable mass. (We shall assume in this article 
that the lepton is significantly more massive than the two 
neutrinos and decouples; we leave its inclusion for future 
work.) This limit was considered in a recent paper |17j 
which reanalyzed the bounds from the LEP2 analysis on 



this parameter space. It was shown in 17] that the LEP 
bounds on the neutrino mass should be weakened sig- 
nificantly as compared to the single neutrino case; for 
example, a neutrino decaying to rW could be as light as 
62.1 GeV, as compared to the original bound of 80.5 GeV 
in the limit where only one neutrino is light (bounds were 
reduced to about 80 GeV for eW and /xW decay modes) . 
There is therefore a large parameter space newly opened 
for analysis. 

This article addresses the open question of whether 
the Tevatron can improve these bounds in the general 
two-neutrino case. The Tevatron has not performed an 
analysis; however, a sensitivity study [18] indicated that 
the Tevatron could significantly improve the mass bounds 
on the neutrino in the one-neutrino limit. For this limit, 
the sensitivity study showed that, at least for the /xW 
decay mode, the Tevatron could expect to dramatically 
improve the mass bounds to 175 GeV. This suggests that 
for the two-neutrino parameter space, the Tevatron will 
again have significant reach. 

In this article, we present a sensitivity study for the 
Tevatron in the more general two-neutrino mixing space 
and show that in fact the neutrino mass bounds can be 
significantly improved. We note that previous studies 
have explored the possibility of searching for neutrinos at 
the LHC _14J and a future ILC [19]; however, a Tevatron 
sensitivity study has not been performed. 

We begin by reviewing the theory of the two-neutrino 
system, and discussing the production and decay of these 
particles at hadron colliders. We then calculate experi- 
mental sensitivity for a selection of same-charge leptons, 
using Monte Carlo simulation. Finally we discuss our 
results and conclude. 



II. PRODUCTION AND DECAY OF FOURTH 
GENERATION NEUTRINOS 

The mass term for the two-neutrino system can be 
written as [TTIEO] 
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The mass eigenstates are 

iVi = cgNl + seNn + cgNL + s^A^^ 

N2 = -iSgNl + icgNR + ISgNL ~ iCgN'-j^ 

with corresponding eigenvalues 



Ml = -(M/2) + y^ml^ + Af 2/4 
Af2 = (Af/2) + Jml^ + Af 2/4 



(2) 
(3) 



(4) 
(5) 



Here ^'^ = —172-0* and Qi? = N^. The mixing angle is 
related to the masses by the relation 



cos^ d = 



A/, 



Af 2 + Afi 



(6) 



and varies over the range \ < cos2 6 < 1. 

The neutrinos couple to the gauge bosons through the 
interaction term L = gW+Jf"-^ + gW~ J^^' + gZ^.J'^ 
where 

J^ = ^ ^. {-clN.rj'N, - 2tseCgN,j'^N2 
2 cos Ow 

~slN2ri'N2)) (7) 

J^+ = c,(ceA^i-is9iV2)7^;i (8) 

where Ci are analogous to the CKM matrix elements. 

At colliders, the neutrinos can be produced either 
through the process qq' ^ W^ —> Nil^ , where one of 
the fourth generation neutrinos is produced in associa- 
tion with a light charged lepton, or through the process 

qq 



Z — > NiNj, where two heavy neutrinos are pro- 



duced. There are many papers studying the reach of 
the Tevatron and LHC to the W process [HHj- This 
is because the W production has a higher cross section 
at hadron colliders, and is expected to dominate. Fur- 
thermore, the mass reach is enhanced because only one 
heavy particle is produced in this process. On the other 
hand, the cross-section for the first process depends on 
the values of Ci, the parameters that control the mix- 
ing between the fourth generation with the first three 
generations. These constants are not theoretically calcu- 
lable, but precision measurements suggest that this angle 
is small. If the mixing angle is less than about 10~^, the 
neutrino production rates in this channel are suppressed 
enough that they are unobservable at colliders 9;. The 
rate of heavy neutrino pair-production via a Z boson, 
however, does not depend on the mixing parameter. We 
will assume that we are in the regime where this mixing 
angle is small, and production through an s-channel Z is 
the dominant production mechanism. 

The decay time of the neutrinos also depend on the 
unknown c^, but A'^i always decays to IW, where / is a 
lepton of the first three generations. We will assume that 
the decay happens promptly and that the neutrino does 
not escape or leave displaced vertices; this will happen 
unless the mixing angle is extremely tiny |13j . A'2 decays 
to IW or NiZ; the IW channel is suppressed by the small 
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FIG. 1: Left, cross-section for pp — >■ Z — >■ A^TV where 
NN = iViiVi + N1N2 + N2N2 as a function of the JVi 
mass (A/i) and the mixing angle 9. Right, acceptance of 
our selection, averaged over the NiNi, N1N2, N2N2 modes 
if BR(iV -^ nW) = 100%. 



Ci , and the A^i Z channel will dominate except if the mass 
difference is very small. We will assume that the mass 
difference is at least 1 GeV, and we assume that the CKM 
factor is so small that the NiZ decay always dominates 
in this range. 

Note that in the exact Dirac limit, N2 must decay to 
IW. In this limit, the different contributions to same 
sign dilepton production cancel. This is expected since 
the Dirac fermion conserves fermion number. However, 
since we are assuming that N2 always decays to NiZ 
(i.e. we do not take the exact Dirac limit), there is no 
interference amplitude, giving same-sign dilepton decays 
in the entire mixing space. 

We therefore consider the processes 



pp^ Z ^ NiNi -^ IWIW 
pp^ Z ^ N1N2 -^ IWIWZ 
pp-f Z ^ N2N2 -^ IWIWZZ 



(9) 
(10) 

(11) 



In each case, half the decays have same sign leptons and 
correspondingly same sign VFs. 

Figure [l] shows the total cross-section for all three 
processes as a function of Ni mass and mixing an- 
gle 0. Decays via a Higgs boson were also considered 
{h — >• NiNi,h — T' N2N2), but the large Higgs mass re- 
quired to pair produce the heavy neutrinos makes the 
Higgs contribution small as compared to the production 
via Z. 



III. EXPERIMENTAL SENSITIVITY 

We study the most sensitive region, where BR(A^ — )■ 
liW) — 100%. Following [T5], we select events with the 
^^^'^ij signature: 

• two like-signed reconstructed muons each with 
Pt > 20 GeV and \r]\ < 2.0 

• at least two reconstructed jets, each with px > 15 
GeV and |?7| < 2.5 
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FIG. 2; For Mi = 150 GeV, and cos^0=O.67. Left, recon- 
structed Ml in selected events with for NiNi,NiN2,N2N2 
modes. Other masses and mixing angles are qualitatively sim- 
ilar. Right, expected signal and backgrounds in 5/ih of CDF 
data. 
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The efficiency of the selection is shown in Figure [T] and is 
a strong function of iVi mass; when Mi — raw is smaU, 
the lepton from the A^i —!• IW decay has small transverse 
momentum and is difficult to reconstruct. 

We reconstruct one or two A^i masses in each event 
using all rrijji combinations where rrijj is consistent with 
a hadronic W decay. Figure [2] shows the reconstructed 
A^i mass shape for the NiNi,NiN2, and N2N2 modes. 

At CDF, the largest backgrounds to the i^i^jj signa- 
ture come from Wj or WZ production or misidentified 
leptons [H] either from semi-leptonic tt decays or direct 
W+ jets production. As in [18], we extrapolate the 
number of expected backgrounds events in 1 fb~^ [21] to 



a dataset with 5 fb , use madgraph 



to model the 



kinematics of the events, PYTHIA [23] for showering and a 
version of PGS [24] tuned to describe the performance of 
the CDFII detector. Figure [2] shows the expected signal 
and backgrounds in 5 fb~^ of CDF data. We perform a 
binned likelihood fit in the reconstructed Ni mass, and 
use the unified ordering scheme [25] to calculate median 
expected limits from frequentist intervals. 

We present the expected Tevatron constraints in the 
(Mi,cos^0) plane in Fig ^ The shaded regions show 
regions that can be excluded by a Tevatron search, as- 
suming BR{N -^ ^iW) = 100%. 

The shape of the constraints can be understood as fol- 
lows. In the limit cos^ = 1, M2 is infinite, and we return 
to the one-neutrino case. As cos^ 9 decreases, the mixing 
angle between the Z and the lighter neutrino is reduced, 
leading to a smaller cross-section and therefore a weak- 
ening of the bounds. On the other hand, as cos^ 9 de- 
creases, the heavier neutrino mass is also reduced (when 
cos^ 6* = 1/2, the neutrinos are degenerate); as a conse- 
quence, as we reduce cos^ 9 from 1 to 1/2, the heavier 
neutrino eventually becomes light enough that it is ac- 
cessible to production. At this point, the bounds again 
improve. The mass exclusion therefore weakens and then 
strengthens as a function of cos^ 9. Furthermore, at lower 
values of Mi , there is a gap which is not excluded by our 
study. This occurs because the leptons from N — ^ IW 



FIG. 3: Expected 95% C.L. exclusion regions for 5 fb ^ of 
CDF data, as a function of the A^i mass and the mixing angle 



become very soft, and fall below the px cut. 

For cos^ 9 very close to 1/2, we approach the Dirac 
limit. In this limit, the decay N2 ^ NiZ may open up 
(depending on the mixing between the fourth and the 
other generations). We therefore impose the condition 
M2 > Ml + 1. There is thus a narrow strip on the left of 
the plot which is excluded from our analysis. 

Our analysis has assumed that the neutrino only de- 
cays to /iW. If the neutrino decays to eW or rW as well, 
the limits will be degraded. This was analyzed for the 
one-neutrino case in [TS] and it was shown how the lim- 
its are reduced. Since we describe the identical selection 
here, our limits will degrade in the same manner. 



IV. CONCLUSIONS 

We have shown that the Tevatron has a significant 
reach to fourth generation neutrinos, and can place signif- 
icant constraints on the general two-neutrino parameter 
space. Quantitatively, if the A'^i , N2 do not exist and no 
excess is seen, CDF can exclude the existence of iVi , N2 
up to 150-170 GeV, depending on the mixing angle, with 
the exception of a band between 83-97 GeV, where the ac- 
ceptance is very small due to the softness of the produced 
lepton. This makes a strong case to search for potential 
signals of these neutrinos in the current dataset. 

These results leave open several interesting directions 
for future research. Perhaps the most difficult and im- 
portant is to cover the gap where the neutrino mass is 
close to the W mass by understanding the backgrounds 
to very soft leptons. In addition, we hope to include the 
charged leptons in future studies. 
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